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[57] ABSTRACT 

The algorithm assumes a constant bit rate over a timing 
window of specified duration (e.g., a specified number of 
consecutive frames), where die current frame to be encoded 
lies in the interior of me timing window. A target bit rate for 
the current frame is initially selected by calculating the 
number of bits already used to encode other frames within 
the window and then assuming that the remaining available 
bits allocated to the timing window will be evenly distrib- 
uted to the remaining unencoded frames in the timing 
window. The target bit rate may then be optionally adjusted 
based on scene content, encoder state, and buffer consider- 
ations. Through a combination of target bit allocation and 
frame skipping, spatial and temporal resolutions are main- 
tained within acceptable ranges while meeting buffer delay 
constraints. The algorithm has also been extended to include 
PB frames in addition to P-only coders. 

22 Claims, 2 Drawing Sheets 
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FRAME-LEVEL RATE CONTROL FOR 
VIDEO COMPRESSION 

CROSS-REFERENCE TO RELATED 
APPLICATIONS 

This application claims Ihe benefit of the filing date of 
U.S. provisional application No. 0/100,939, filed on Sep. 18, 
1998 as attorney docket no. SAR 12728P. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates to image processing, and, in 
particular, to video compression. 

2. Description of the Related Art 

The goal of video compression processing is to encode 
image data to reduce the number of bits used to represent a 
sequence of video images while maintaining an acceptable 
level of quality in the decoded video sequence. This goal is 
particularly important in certain applications, such as real- 
time video conferencing, where transmission bandwidth 
limitations may require careful control over the bit rate, that 
is, the number of bits used to encode each image in the video 
sequence. In order to satisfy the transmission and other 
processing requirements of a video conferencing system, it 
is often desirable to have a relatively steady flow of bits in 
the encoded video bitstream. 

Achieving a relatively uniform bit rate can be very 
difficult, especially for video compression algorithms that 
encode different images within a video sequence using 
different compression techniques. Depending on the video 
compression algorithm, images may be designated as the 
following different types of frames for compression process- 
ing: 

An intra (I) frame which is encoded using only intra- 

frame compression techniques, 
A predicted (P) frame which is encoded using inter-frame 
compression techniques based on a previous I or P 
frame, and which can itself be used as a reference frame 
to encode one or more other frames, 
A bidirectional (B) frame which is encoded using bidi- 
rectional inter-frame compression techniques based on 
a previous I or P frame and a subsequent I or P frame, 
and which cannot be used to encode another frame, and 
A PB frame which corresponds to two images — a P frame 
and a subsequent B frame — that are encoded as a single 
frame as in the H.263 video compression algorithm. 
Depending on the actual image data to be encoded, these 
different types of frames typically require different number 
of bits to encode. For example, I frames generally require the 
greatest numbers of bits, while B frames generally require 
the least number of bits. 

In a typical transform-based video compression 
algorithm, a block-based transform, such as a discrete cosine 
transform (DCT), is applied to blocks of image data corre- 
sponding to either pixel values or pixel differences 
generated, for example, based on a motion-compensated 
inter-frame differencing algorithm. The resulting transform 
coefficients for each block are then quantized for subsequent 
encoding (e.g., run-length encoding followed by variable- 
length encoding). The degree to which the transform coef- 
ficients are quantized (also referred to as the quantization 
level) directly affects both the number of bits used to 
represent the image data and the quality of the resulting 
decoded image. In general, higher quantization levels imply 
fewer bits and lower quality. As such, quantization level is 
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often used as the primary variable for controlling the tradeoff 
between bit rate and image quality. 

At times, using quantization level alone may be insuffi- 
cient to meet the bandwidth and quality requirements of a 

5 particular application. In such circumstances, it may become 
necessary to employ more drastic techniques, such as frame 
skipping, in which one or more frames are dropped from the 
video sequence. Such frame skipping may be used to sac- 
rifice short-term temporal quality in the decoded video 

io stream in order to maintain a longer-term spatial quality at 
an acceptable level. 

SUMMARY OF THE INVENTION 

The present invention is directed to an algorithm for 

15 achieving frame-level bit-rate control for video compression 
processing for applications such as video conferencing in 
which real-time processing and transmission requirements 
make such rate control especially important. According to 
one embodiment, the present invention is a method for 

20 controlling bit rate by a machine implementing video com- 
pression processing of a video sequence to select a target bit 
rate for a current frame in the video sequence, comprising 
the steps of (a) generating a number of bits used to encode 
a previous M frames in the video sequence, wherein M is a 

25 specified number of frames; (b) generating a number of 
available bits for an unused portion of a multi-frame bit 
budget corresponding to a specified number of bits available 
for encoding N frames in the video sequence, wherein N is 
a specified number of frames and M<N, by subtracting the 

30 number of bits used to encode the previous M frames from 
the multi-frame bit budget; (c) generating the target bit rate 
for the current frame by dividing the unused portion of the 
multi-frame bit budget by (N-M); and (d) encoding the 
current frame based on the target bit rate. 

35 

BRIEF DESCRIPTION OF THE DRAWINGS 

Other aspects, features, and advantages of the present 
invention will become more fully apparent from the follow- 
ing detailed description, the appended claims, and the 
accompanying drawings in which: 

FIG. 1 shows a flow diagram of the processing imple- 
mented by a P-frame-only coder to select a target number of 
bits for encoding the current frame, according to one 
45 embodiment of the present invention; and 

FIG. 2 shows a flow diagram of the processing corre- 
sponding to a frame-skipping strategy, according to one 
embodiment of the present invention. 

DETAILED DESCRIPTION 

50 

In one embodiment, the present invention is directed to a 
frame-level rate control and skipping strategy for a real-time 
video conferencing system that allocates frame-level targets 
(i.e., allocations of bits) based on scene content, encoder 

55 state, and buffer considerations. The algorithm maintains a 
constant bit rate over a timing window of specified duration 
(e.g., specified number of consecutive frames), while allow- 
ing variations in the target and actual bit rates used to encode 
individual frames. Through a combination of target bit 

60 allocation and frame skipping, spatial and temporal resolu- 
tions are maintained within acceptable ranges while meeting 
buffer delay constraints. The algorithm may be extended to 
include PB frames in addition to P frames. 
Notation 

65 The following notation is used in this specification: 

R: Channel transmission rate in bits/sec (e.g., 24000 
bits/sec). 
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Bpp: Bits per picture-R/original_frame_rate (e.g., for an target is modified based on one or more of the following 

original frame rate of 30 fps and R-24Kbps, Bpp-SOO optional considerations: (a) quantizer saturation, (b) distor- 

bits per picture). tion after motion compensation as compared to distortion 

Bprev: Bits used to encode the previous frame. over the previous frames, (c) bit count for the previous 

fs: Frame skip corresponding to the desired average frame 5 frame « and ( d ) buffer fullness. 

rate (e.g., for input video having 60 fps and a trans- In particular, for quantizer saturation, if the quantizer 

mission rate of 15 fps, fs-4). parameter OP saturated for the previous picture (e.g., mean 

acl_buf_size: The actual size of the encoder buffer. This QP>25 for a system having 31 quantization levek) the 

is governed by the picture format. CUI f nt frame tar 6 et T ma y ** "» creased ( ste P 108 of nG - « 
xrn ^° .„-.,„ . , , ,10 as follows: 
VBVf_b: Buffer fullness before putting the currently 

encoded frame bits into buffer. T~T m (\+£ m (QP-QP_jfuesh)) 
VBVf_a: Buffer fullness after putting the currently 

encoded frame bits into buffer. where p is a specified factor (e.g., 0.06) and QP_threshold 

max_buf_size: The maximum size of the steady state 35 15 a SP*^ saturated quantization level (e.g., 25). 

buffer. In one embodiment, this is chosen to be R/2, ^ quantizer parameter is not saturated, the target 

which means that 0.5 secoods is the upper bound on T ma y modified based on current and past distortions 

buffer delay. ( stc P 110 ) as follows: 

ssbs: The desired VBVf_a (steady state buffer size). r«r* (Jp+**5)/(**^>+^) 

S, Sp: Interframe distortion after motion compensation for 20 

the current frame and average distortion over a sped- where S is the motion-compensated distortion (e.g., based 

fled number of previous frames, respectively. on a sum of absolute pixel differences (SAD) measure) for 

Frame Skipping Strategy the current frame, Sp is the average motion-compensated 

In order to meet buffer delay constraints while maintain- distortion over the past M frames (e.g., M=2), and k>l (e.g., 

ing the spatial quality within acceptable limits at a given bit 25 k=4). Sp is preferably a weighted average that emphasizes 

rate, frame skipping may be adopted. In one embodiment, more recent data. 

the average delay for a frame in the buffer is constrained to The target T may also be modified based on the number 

be ssbs/R, and the maximum delay is dictated by the of bits used for the previous frame (Bprev) (step 112) as 

accuracy with which the target is met. Usually, it is only follows: 

marginally larger that ssbs/R. The skip after encoding a 30 

picture is computed as follows: r-oT+li-o)'/^ 

where 0<«a<=l (e.g., a-0.7). This step reduces fluctuation 

in the quality of reference frames, and helps ensure that any 

Set skip-i, and VBVf_b - VBVf_» - Bpp. 35 degradation over time is graceful. 

while (VBVLb + Bf> M te){ The target T may also be modified based on buffer fullness 

if(VBVf_b . Bpp < 0) break; , m) foil™. 

/• this avoids underflow and imder-utilizaiion of bits •/ ^ lcp lonows. 

VBVfLb - VBVf_b - Bpp T-r(a+\'b)l(k'<Hb), 

40 where a-VBVf__b (the buffer fullness before putting the 

r , _ . , , j . currently encoded frame bits into the buffer), b-ssbs- 

Bf is the estimate for the next frame to be encoded and is aQd K>1 ^ eQables ^ d ^ take 

computed as (B P rev + Bpp*fs)/2 Thus, the algorithm a{Jva of ^ buffcf , f ^ fc kss than half of thc 

attempts to maintain thc buffer delay around ssbs/R. dcsir6d stcad buffcr shc Q lhcQ ^ 

Frame-Uvel Rate Control for P-Frame-Only Coders 45 ^ incrcased othenvi ^ ^ fe 

C a I &h S7 2 fl0W , dia 5 am ° f pr0CCSSing f pIe : The resulting target T is then used to encode the frame 

mented by a P-fbmc-only coder to select a target number of ( m) for { ^ macroblock adaptation of the 

bits (T) for encoding the current frame, according to one Qp (quantization parameter) bascd on me tm N 5 or tm N 

embodiment of the present invention The processing g ^ ics for ^ H . 263 standard, 

depicted in FIG. 1 is described in the following sections. 50 High . M * tioo Excc tion 

Target Computation over a Window of Frames Iq ^. mQt]oa re ^ 0QSt the above ^ rilhm , ead lo 

Under the processing of FIG. 1, an attempt is made to ^ of ^ „ ^ th{j ^ ^ ^ ^ fl , 

maintain a constant bit rate over a window of W frames, Ume to recover ^ - n ^ siluati the aIgorithm may 

centered at the current frame being encoded. For the first Nl take a(Jva of ^ buffef afld choQse tQ ^ ^ * 

frames in the window, the number of bits (Bl) used to 55 ( U6 m RG 1} Furlbermoret when the al rithm 

encode those frames is calculated (step 102 of FIG. 1) The ^ tQ „ stead ' „ ^ a , ^ M 

number of frames eft to be encoded is N2KW-Nl)/fs, ^ frame > ±c stcad s * te ^ approximately 

where Nl is the total number of frames processed including fe * B } Graccful degradation may ^ a V chieved bascd on J 

those that are skipped. The available number of bits for the „ ■ uT H a,,.-™. rtri ,h<. ,„:»», th- «™.w,™.c hit ™„„, 

, . . . . r r "n ^ r weighted average on the target with the previous bit count 

whole window is Bw-W*Bpp. The target T for the current 60 R ZT. f e * n t e . 

frame is T-(Bw-Bl)/N2 (steps 104 and 106). This compu- P ' P ' 

tation comes from the assumption that the same number of m&T+Q.iBpnv 

bits will be used for each of the remaining frames in the 

window. This would enable the algorithm to maintain the spatial 

Target Modification 65 quality of the frames even in the presence of abrupt motion, 

This section describes an algorithm to modify the target T and allows the algorithm to recover faster when the scene 

based on the state of the encoder and the scene content. The motion reduces. 
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The high-motion detection may be based on a comparison 
between the current motion-compensated distortion (S) and 
the weighted average of the previous motion-compensated 
distortions (Sp). In one embodiment, the target modification 
is implemented as three linear segments selected to approxi- 
mate a smooth curve, where: 

r-(l+4*/flcto/-)/(4+/acror)*r foi factor<1.05 
T-{l.Q3+<factor-\.OSyo.3)'T for 1.05<factor<1.15 
7"-<1.36+4*(rflCtor-1.15))*r for f*ctor>l.l5 

where faclor=S/Sp. 

Frame-Level Rate Control for Coders using PB or P Frames 
The strategy described above was designed to code P 
frames only. In this section, the strategy is extended to 
coders with PB frames. 

When P and PB frames are mixed, the delays for the P 
frames are significantly lower than the delay for the B frame 
of a PB frame (for the same skip). For ease of discussion, it 
is assumed that the algorithm operates at a constant frame 
skip fs. In that case, the overall system delay for a typical 
P-only frame from the moment of capture to availability at 
the decoder is given as follows: 

fs/ref_frame_rate+VBVf_b/R+processing delays- 
channel delay, while the delay for the B frame of a 
typical PB frame is given as follows: 
3fs/ref_frame_rate4-VBVf_b/R+processing delay+ 
channel delay In general, VBVf_b is lower for the PB 
frame than the P frame, since a PB frame has to wait for 
the P frame (which is typically 2*fs from the previous 
reference frame and thus depleting the buffer more) 
before encoding. 
Thus, when P and PB frames are mixed, delays for the P 
frames are smaller than those for the PB frames. To keep the 
delays equal, the following guidelines may be adopted: 

1. The VBVf_b before encoding a P-only frame is fs*Bpp 
more than the VBVf_b before encoding a PB frame. 

2. Each P frame is delayed by fs*Bpp/R at the decoder 
before it is displayed. 

FIG. 2 shows a flow diagram of the processing corre- 
sponding to a frame-skipping strategy based on the above 
guidelines, according to one embodiment of the present 
invention. According to this strategy: 

1. First, determine the skip after the previous reference 
frame based on the strategy used in the P-only case 
(step 202 of FIG. 2). The only difference comes in the 
case where the previous frame was a PB frame. In that 
case, the number of bits used to encode the previous 
frame (Bprev) is twice the number of bits required for 
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VBV _JuIlncss+max{Bpre\; 2'fs*Bpp)<ssbs 

According to this equation, the buffer fullness after encoding 
the PB-frame should be less than the stcady-state-buffer size 
ssbs. The term max(Bprev, 2*fs* Bpp) is used to estimate the 
number of bits for the frame. Thus, skip is incremented until 
the buffer fullness, after encoding, drops below ssbs. Then, 
encode the PB frame (step 214) and go to step 1. 

In the case where high motion is detected between the B 
and P frames of a PB frame, the PB mode is turned off for 
this frame and the P frame of the "PB" frame is encoded as 
a P-only frame. This situation should not occur very often in 
a sequence. 

Motion Detection for the PB decision 

The PB decision described previously requires a high- 
motion detector. This detector may be implemented as 
follows. 

1. Determine the number of blocks that are moving (Ml) 
(step 204 of FIG. 2). This may be determined from the 
raw frame differences or from the motion-compensated 
frame differences and the motion field. If motion esti- 
mation is performed, Ml refers to the number of blocks 
having a non-zero motion vector. Otherwise, Ml refers 
to the number of blocks having a distortion measure 
greater than some specified threshold level (e.g., 
SAD>100). 

2. Determine the number of blocks that have high motion 
(M2) (step 206), again based on either the raw frame 
differences or the motion-compensated frame differ- 
ences and the motion field. If motion estimation is 
performed, M2 refers to the number of blocks whose 
motion vector has a magnitude greater than a specified 
threshold level. If motion estimation is not used, M2 
refers to the number of blocks having a distortion 
measure greater than some specified high-motion 
threshold level (e.g., SAD>750). 

3. If M2/M1 is greater than a specified threshold level 
(e.g., 1.15) (step 208), then code the current frame as a 
P frame (step 210); otherwise, code the current frame as 
a PB frame (steps 212-214). 

SUMMARY AND CONCLUSIONS 



The frame-level rate control of the present invention is 
45 particularly applicable in real-time very low bit-rate coders. 
The algorithm can be implemented by coders using only P 
frames as well as coders using PB-frames, an added func- 
tionality when compared to the TMN8 test model for the 
H.263+standard. The algorithm provides a buffer delay 
one frame, and this is divided by 2 when the number of 5 0 variable, which can be selected by a user to trade delay for 
bits for the current frame is estimated. graceful change in spatial quality over time. By adapting the 

2. Then, perform a PB decision to decide whether or not target bit allocation for a frame to the scene content, spatial 
to code the current frame as a P frame. The strategy is quality is maintained in high-motion areas and quick recov- 
based on the observation that I I. 263 PB frames do not ery is made possible after an abrupt motion, while main- 
work well for large motion. (This statement is not 55 taining the buffer delay within desired limits, 
necessarily true in the improved PB mode). Thus, if The present invention can be embodied in the form of 
large motion is detected (steps 204-208), the decision methods and apparatuses for practicing those methods. The 
is made to encode the current frame as a P frame (step present invention can also be embodied in the form of 
210). One possible high-motion detection algorithm is program code embodied in tangible media, such as floppy 
described in the next section. If the algorithm chooses 60 diskettes, CD-ROMs, hard drives, or any other machine- 



to encode this frame as a P frame, then the processing 
returns to step 1 after encoding the P frame. 
3. If a PB frame is coded, the algorithm determines the 
skip between the B frame and the P frame of the PB 
frame based on the buffer fullness (step 212). 
Essentially, the algorithm determines the skip as fol- 
lows: 



65 



readable storage medium, wherein, when the program code 
is loaded into and executed by a machine, such as a 
computer, the machine becomes an apparatus for practicing 
the invention. The present invention can also be embodied in 
the form of program code, for example, whether stored in a 
storage medium, loaded into and/or executed by a machine, 
or transmitted over some transmission medium, such as over 
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electrical wiring or cabling, through fiber optics, or via 10. The invention of claim 9, wherein step (c) comprises 

electromagnetic radiation, wherein, when the program code the step of adjusting the target bit rate T as follows: 
is loaded into and executed by a machine, such as a 

computer, the machine becomes an apparatus for practicing r-r»(a+x*z>V(X'j+6), 

the invention. When implemented on a g^ral-purposc 5 ^ ^ buffef ^ 

processor, the program code segments combine with the * encoded frame bits into the buffer, b is a 

processor to provide a unique device that operates analo- * ^ J {Q ^ ^ fe ft ter 

gously to specific logic circuits. £ a siea ^ buffer and x fc fl med ^ 

It will be further understood that various changes m the > j 

details, materials, and arrangements of the parts which have 10 u ^ of cUim ! whercin slep (c) compriscs 

been described and illustrated in order to explain the nature the farthcr step of justing the target bit rate based on a 

of this invention may be made by those skilled in the art characterization of motion. 

without departing from the principle and scope of the 12. The invention of claim 11, wherein step (c) compriscs 

invention as expressed in the following claims. me step of adjusting , he targct bil ratc „ a faac&>n of S/Sp> 

What claimed is: where s is a parameter equal to a motion-compensated 

1. A method for controlling bit rale by a machine imple- distortion levcl for tne current frame and Sp is a parameter 
menting video compression processing of a video sequence , , Q m a motion-compensated distortion level 
to select a target bit rate for a current frame in the video ovcr a previous number of frames> 

sequence, comprismg the steps of: 13 ^ invention of claira 12> wberein lhe function ^ 

(a) generating a number of bits used to encode a previous 20 implemented as a plurality of linear segments relating S/Sp 
M frames in the video sequence, wherein M is a lo a f actor use d t0 adjust the target bit rate. 

specified number of frames; 14. The invention of claim 1, wherein step (c) further 

(b) generating a number of available bits for an unused comprises the steps of: 

portion of a multi-frame bit budget corresponding to a (1) adjusting the target bit rate based on presence of 

specified number of bits available for encoding N quantizer saturation- 

frames in the video sequence wherein N is a specified (2) ^ ' ^ me ^ QQ ^ 

number of frames and M<N, by subtracting the number v d i st0 rtion levels* 

of bits used to encode the previous M frames from the ' 

multi-frame bit budget; ( 3 ) adjusting the target bit rate based on the number of bits 

y v . 4 ... . - . c , 30 used to encode a previous frame; 

(c) generating the target bit rate for the current frame by * 

dividing the unused portion of the multi-frame bit ( 4 ) adjusting the target bit rate based on buffer fullness; 

budget by (N-M); and 311(1 

(d) encoding the current frame based on the target bit rate. ( 5 ) adjusting the target bit rate based on a characterization 

2. The invention of claim 1, wherein step (c) comprises 35 °f motion. 

the further step of adjusting the target bit rate based on 15 ^ invention of claim 14, wherein: 

presence of quantizer saturation. step (c)(1) comprises the step of increasing the target bit 

3. The invention of claim 2, wherein step (c) comprises rale if a quantizer parameter for a previous frame was 
the step of increasing the target bit rate if a quantizer greater than a specified threshold level; 
parameter for a previous frame was greater than a specified ^ s t e p (cX2) comprises the step of adjusting the target bit 
threshold level. rate T as follows: 

4. The invention of claim 1, wherein step (c) comprises 

the further step of adjusting the target bit rate based on T-T*(Sp+k*S)f(k*Sp+S), 
current and past distortion levels. 

5. The invention of claim 4, wherein step (c) comprises 45 where S is a motion-compensated distortion level for the 
the step of adjusting the target bit rate T as follows: current frame, Sp is a weighted average motion- 
compensated distortion over a previous number of frames, 

T-T*(Sp+k*fy(k m Sp+S) t and k is a specified parameter >1; 

where S is a motion-compensated distortion level for the sle P (c)(3) comprises the slep of adjusting the target bit 

current frame, Sp is an average motion-compensated distor- 50 rate as 0 ows ' 

tion over a previous number of frames, and k is a specified T-a*T+(l-ayBpKy 
parameter >1. 

6. The invention of claim 5, wherein Sp is a weighted where Bprev is the number of bits used to encode the 
average that emphasizes more recent frames. previous frame and a is a specified parameter such that 

7. The invention of claim 1, wherein step (c) compriscs 55 0<«a<-l; 

the further step of adjusting the target bit rate based on the step (cX4) comprises the s i ep of adjusting the target bit 

number of bits used to encode a previous frame. rate j as f 0 u ows: 

8. The invention of claim 7, wherein slep (c) comprises 

the step of adjusting the target bit rate T as follows: T-T*(a+k m b)fQ.'a+b), 

60 

TmQ*T+(i-a)' Bprev, where a is a parameter equal to the buffer fullness before 

where Bprev is the number of bits used to encode the putting currently encoded frame bits into the buffer, b is a 

previous frame and a is a specified parameter such that parameter equal to ssbs-a, where ssbs is a parameter equal 

0<-a<-l. to a steady stale buffer size, and X is a specified parameter 

9. The invention of claim 1, wherein step (c) comprises 65 >J i an0 " 

the further step of adjusting the target bil rate based on buffer step (cX5) comprises the step of adjusting the larget bit 

fullness. rate as a function of S/Sp, where S is a parameter equal 
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to a motion-compensated distortion level for the current 
frame and Sp is a parameter equal to an average 
motion-compensated distortion level over a previous 
number of frames, wherein the function is implemented 
as a plurality of linear segments relating S/Sp to a factor 
used to adjust the target bit rate. 
16. A computer-readable medium having stored thereon a 
plurality of instructions, tbe plurality of instructions includ- 
ing instructions which, when executed by a processor, cause 



18. The invention of claim 16, wherein step (c) comprises 
the further step of adjusting the target bit rate based on 
current and past distortion levels. 

19. The invention of claim 16, wherein step (c) comprises 
the further step of adjusting the target bit rate based on the 
number of bits used to encode a previous frame. 

20. The invention of claim 16, wherein step (c) comprises 
the further step of adjusting the target bit rate based on buffer 



the processor to implement a method for processing image 10 fullness, 
data, the method comprising the steps of: 

(a) generating a number of bits used to encode a previous 
M frames in the video sequence, wherein M is a 
specified number of frames; 

(b) generating a number of available bits for an unused 
portion of a multi-frame bit budget corresponding to a 
specified number of bits available for encoding N 
frames in the video sequence, wherein N is a specified 
number of frames and M<N, by subtracting the number 
of bits used to encode the previous M frames from the 
multi-frame bit budget; 

(c) generating the target bit rate for the current frame by 
dividing the unused portion of the multi-frame bit 
budget by (N-M); and 

(d) encoding the current frame based on the target bit rale. 
17. The invention of claim 16, wherein step (c) comprises 

the further step of adjusting the target bit rate based on 
presence of quantizer saturation. 



21. The invention of claim 16, wherein step (c) comprises 
the further step of adjusting the target bit rate based on a 
characterization of motion. 

22. Tbe invention of claim 16, wherein step (c) further 
15 comprises the steps of: 

(1) adjusting the target bit rate based on presence of 
quantizer saturation; 

(2) adjusting the target bit rate based on current and past 
20 distortion levels; 

(3) adjusting the target bit rate based on the number of bits 
used to encode a previous frame; 

(4) adjusting the target bit rate based on buffer fullness; 

25 aDt * 

(5) adjusting the target bit rate based on a characterization 
of motion. 
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